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REMARKS 



Claims 10-14 are pending in this application. By this Preliminary Amendment, 
Applicant AMENDS the specification and the abstract of the disclosure, CANCELS 
claims 1-9 and ADDS new claims 10-14. 

Applicant has attached hereto a Substitute Specification in order to make 
corrections of minor -informalities contained in the originally filed specification. 
Applicant's undersigned representative hereby declares and states that the Substitute 
Specification filed concurrently herewith does not add any new matter whatsoever to the 
above-identified patent application. Accordingly, entry and consideration of the 
Substitute Specification are respectfully requested. 

The changes to the specification have been made to correct minor informalities 
to facilitate examination of the present application. 

Applicant respectfully submits that this application is in condition for allowance. 
Favorable consideration and prompt allowance are respectfully solicited. 
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DESCRIPTION 

Attorney Docket No. 38195.70 

A VIDEOPHONE SIGN LANGUAGE VIDEO PRESENTATION INTERPRETATION 
ASSISTANCE DEVICE , A SIGN LANCUACE VIDEO INPUT/OUTPUT DEVICE, 
AND A SIGN LANGUAGE INTERPRETATION SYSTEM USING THE SAME 

TQchnical B ackground of the Invention 
1 . Field of the Invention 

The present invention relates to a sign language video 

presentation device which presents — a sign language video by 
using communications means such as a videophone to a deaf mute 
person, — a — sign — language — video — input/ output — device — which 
inputs /outputs — a — sign — language — video, — af^s 1 — a — sign language 

interpretation system — which provides a — sign language 

interpretation — service — by — way — of — a — videophone, and — if* 
particular to a sign language video presentation device, a sign 
language — video — input/output — device , — aftd — a — sign — language 
interpretation system preferable in case a deaf mute person 
who — ±s — eft — the — road — converses — with — a — non deaf mute — person 
incapable — of using — sign — language — while — assisted by — a — sign 
language interpretation service via a videophone. — 

Background Art 
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The present invention relates to a videophone sign 

language interpretation assistance device and a sign language 
interpretation system including the sign language 
interpretation assistance device used by a deaf-mute person 
when the deaf-mute person remotely obtains sign language 
interpretation by a sign language interpreter via a videophone , 
and in particular, the present invention relates to a 
videophone sign language interpretation assistance device and 
a sign language interpretation system including the same to 
be used when a deaf-mute person converses on the road with a 
non-deaf -mute person who is incapable of using sign language. 

2. Description of the Related Art 

A deaf-mute person who is hearing and speaking impaired 
wishing to communicate on the road with a non-deaf -mute person 
who is incapable of using sign language has to use 
communications in writing or find a person capable of using 
sign language. Fluent conversation is difficult by way of 
communications w hen communicating in writing. Moreover, for 
communications using sign language, a very small number of 
non-deaf persons can use sign language. These problems 
present a high barrier in the social life of a deaf-mute person. 

A conversation using sign language over a videophone is 
available at a practical level with the advancement of 
communications technologies. It is possible to provide a sign 
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language interpretation service via a videophone. 

Fig. 1 0 is a conceptual diagram showing a case where 
situation in which a deaf-mute person who is away from home 
converses with a non-deaf -mute person who is incapable of using 
sign language, by way of via a sign language interpretation 
service using a prior art videophone terminal^ such as a 
cellular phone^ equipped with a videophone function. As shown 
in Fig. 10, a deaf-mute person A sets a videophone terminal 
1 0 while watching a video display section 1 0a of the videophone 
terminal 10 s& — such that his/her sign language is picked 
up c aptured in an imaging section 10b. At the same time, the 
deaf-mute person A asks a non-deaf -mute person as a 

conversation partner^ to wear a headset 1 0c for audio 
input/output of the videophone terminal 10, then calls a 
videophone terminal 20 of a sign language interpreter C irn- 
charge — of a sign language interpretation service. Before 
starting b eginning sign language interpretation, the sign 
language interpreter C sets a videophone terminal 20 while 
watching a video display section 1 0a of the videophone terminal 
20 se -such that his/her sign language will appear in an imaging 
section 20b, and wears his/her headset 20c for audio 
input /output . 

While the sign language of the deaf-mute person A is not 
directly understood by the non-deaf -mute person B, the video 
of the sign language is picked up captured by an imaging section 
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10b of the videophone terminal 10, transmitted to the 
videophone terminal 20 and displayed on the video display 
section 20a, &o such that the sign language interpreter C can 
translate the sign language of the deaf-mute person A into et 
voice while watching the video and the voice of the sign 
language interpreter C is collected by the microphone of the 
headset 20c, transmitted to the videophone terminal 10, and 
output to the earphone of the headset 10c. The non-deaf -mute 
person B listens to the voice of the sign language interpreter 
C to understand the sign language of the deaf-mute person A. 

While the voice of the non-deaf -mute person B is not 
directly heard by the deaf-mute person A, his/her voice is 
collected by the microphone of the headset 1 0c of the videophone 
terminal 10, transmitted to the videophone terminal 20, and 
output to the earphone of the headset 20c. The sign language 
interpreter C e-an — trans latc t ran slates the voice of the 
non-deaf -mute person B while hearing his/her voice into £-he 
sign language, the sign language of the sign language 
interpreter is picked up captured by the imaging section 20b 
and transmitted to the videophone terminal 1 0 and displayed 
on the display section 10a. The deaf-mute person A watches 
the sign language of the sign language interpreter C so as to 
understand the voice of the non-deaf-mute person. 

In this way manner , by using a videophone, the deaf-mute 
person A and the non-deaf -mute person B can communicate with 
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each other by calling the sign language interpreter C, even 
when they are away from each other . 

While an example has been described where the sign 
language interpreter uses a — the same type of videophone 
terminal of the cellular phone type as that used by the 
deaf-mute person and the non-deaf -mute person, a sign language 
interpretation center which provides a sign language 
interpretation service may be constructcd p rov ided and a 
desktop- type videophone terminal may be used to provide a sign 
language interpretation service. 

However, when the single videophone terminal is used by 
a deaf-mute person and a non-deaf -mute person to obtain a sign 
language interpretation service, the deaf-mute person must 
keep watching continually watch the display section of the 
videophone terminal while the sign language interpreter is 
translating the voice of the non-deaf -mute person into sign 
language, without watching the express ion expressions or 
gesturc gestures of the non-deaf -mute person as a conversation 
partner at the same time. This makes quick f luent conversation 
difficult and presents a problem in that a deaf-mute person 
cannot adequately understand the intcntion intentio ns or 
f ecling f eelings of a non- deaf -mute person. 

Such a problem of the deaf-mute person's sight line 
occurs when sign language interpretation is provided, as well 
as in many cases where situations in which the deaf-mute person 
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is given an e xplanation with v ia sign language. 

For example, assume a cage where situation in which a 
deaf-mute person is riding in a sightseeing bus. During an 
explanation with via sign language by a guide, as soon as the 
guide draws attention of the passengers to the right (left) 
by using sign language when the bus is at a— an historic site, 
the deaf-mute person shifts his/her eyes from the sign language 
to the historic site , and fails to g^t fully receive the 
explanation of the historic site. 

Similarly, despite explanation with sign language on a 
sightseeing spot location or in an exhibition, a deaf-mute 
person cannot see a— the real object while listening to the 
explanation, eosuch that he/she may fail to not appreciate the 
scene or fail to get efi- the impression which should be given. 

An unimpaired person can hear the explanation given 
eesuch that he/she can shift his/her sight line. A deaf-mute 
person must keep watching the person performing sign language^ 
and is thus^_ handicapped to a great extent. 

A main object 

SUMMARY OF THE INVENTION 

To overcome the problems described above, preferred 

embodiments of the present invention is to provide a videophone 
sign language video — present at ion interpretation assistance 
device , a sign language video input /output device, and a sign 
language interpretation system using the same which 
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cnablc enables a deaf-mute person to get explanation by use a 
videophone to obtain sign language interpretation by a sign 
language interpreter while viewing the outer world by freely 
shifting his/her- sight line. According to a preferred 
embodiment of the present invention, a videophone sign language 
interpretation assistance device used by a deaf-mute person 
when the deaf-mute person remotely obtains sign language 
interpretation by a sign language interpreter in a conversation 
with a non-deaf -mute person by using a videophone includes 
display means fixed on the head of a deaf-mute person for 
displaying the video of a sign language interpreter received 
by a videophone terminal in front of the eyes of the deaf-mute 
person, while enabling the deaf-mute person to view the outer 
world including the expressions of the conversation partner, 
hand imaging means fixed at the waist of the deaf-mute person 
for capturing images of the hands of the deaf-mute person to 
acquire a sign language video, first communications means for 
receiving a video signal from the videophone terminal, 
supplying the video signal to the display means and 
transmitting a video signal acquired by the hand imaging means 
to the videophone terminal, audio input /output means for a 
non-deaf -mute person for input ting/outpu t ting the voice of a 
non-deaf -mute person, and second communications means for 
receiving an audio signal from the videophone terminal, 
supplying the audio signal to the audio input /output means, 
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and transmitting an audio signal acquired by the non-deaf -mute 
person audio input/output means to the videophone terminal, 
wherein the deaf-mute person can obtain sign language 
interpretation by a sign language interpreter while freely 
changing his/her sight line, orientation or position by using 
the display device and the hand imaging means, and the 
non-deaf-mute person can obtain voice translation by the sign 
language interpreter via the audio input/output means. 

Disclosure of the Invention 

The invention described in claim 1 — is a sign language 

video — presentation device — comprising: — sign — language — video 
receiving means for receiving a sign language video; — display 
means for displaying a sign language video received by the sign 
language video receiving means; — and fixing means — — fixing 
the display means in front of the eyes of the deaf mute person, 
characterized in that the deaf mute person can view the sign 
language video received by the sign language video receiving 
means at the same time — he/she views the outer world. — - 

With — this — configuration, — t-he — deaf mute — person — gets 

explanation — sign language while viewing the outer world by 

freely shifting his/her sight line. The display means fixed 

in front of the eyes of the deaf mute person is preferably small 
enough so as not to hamper viewing of the outer world. — 
The invention described in claim 2 is the sign language 



8 



video presentation device according to claim 1 , charact crized 
in that the display means comprises a convex lens which can 
substantially focus on a sign language video displayed on the 
display means at the same time when the deaf mute person views 
the outer world. 

— With this conf iguration, the deaf mute person can watch 

a sign language video displayed on the display means without 
making focus adjustment of eyeballs when he/she views the outer 
world . — The sign language video displayed on the display means 
is enlarged by the convex lens so that the size of the display 
device is reduced. 

The invention described in claim 3 is the sign language 

video — presentation — device — according — t-e — claim — 3 e^e — 2-r 

characterized in that the fixing means has a frame structure 
which can be fixed to the cars and nose of a deaf mute person. 

With — this — configuration, the — deaf mute — person — een 

readily set the display means at the optimum position in front 
of his/her eyes, which adds to the convenience to the deaf mute 
person . — 

The invention described in claim 4 is the sign language 

video presentation device according to any one of claims — V 
through : 3 , — charac tcrized — in — that — t-h-e — sign — language — video 
receiving means comprises videophone connection means to b e 
connected to a videophone terminal. — 

With this configuration, — the deaf mute person can use 
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a general purpose videophone terminal to got explanation by 
sign language while viewing the outer world by freely shifting 
his/her sight line. 

In particular, — the videophone connection means can be 

connected to a videophone of the cellular phone type so that 
the deaf mute person can get explanation by sign language while 
viewing the out e r world by freely shifting his/her sight line 
even when he/she is on the road. — This adds to the convenience 
to the deaf mute person. — 

The invention described in claim 5 is the sign language 

video presentation device according to claim 4, characterized 
— that — the — videophone — connection — means — comprises — radio 
communications means for performing radio communications with 
the videophone terminal. — 

With this configuration, — it is no longer necessary to 

connect — the — sign language video presentation device with a 
videophone — terminal via a — cable , — which greatly — f acilit atcs 
system handling. 

The invention described in claim 6 is a sign language 

video input/output device comprising the sign language video 
presentation device according to any one of claims 1 — through 
3, characterized in that the sign language video input/output 
device includes sign language imaging means for picking up the 
sign language of the deaf mute person and sign language video 
transmission — means — §o^ — transmitting a — sign — language — video 
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picked up by the sign — language — imaging means. — 

With — this — configuration, fcke — deaf mute — person — eaft 

transmit his/her sign language — to the opponent party while 
viewing the sign language of the opponent party, thereby having 
a bidirectional — conversation by way of sign language while 
viewing the outer world by freely shifting his/her sight line. 

The invention described in claim 7 is a sign language 

video input/output device comprising the sign language video 
presentation device according to claim 4 or 5, — characterized 
in that the sign language video input/output device includes 
sign language imaging means for picking up the sign language 
e€ — fe-he — deaf mute — person — aed — video — transmission means — 
transmitting — a — sign — language — video — picked — up — by — th-e — sign 
language imaging means — to the — videophone terminal . — 

With this configuration, — the deaf mute person can use 

a general purpose videophone terminal to have a bidirectional 
conversation by way of sign language while viewing the outer 
world by freely shifting his/her sight — line . — 

The invention described in claim 8 is the sign language 

video input/output device according to claim 7, characterized 
in that the sign language imaging means comprises waist fixing 
means to be fixed at the waist — of the deaf mute person. — 

With — this — configuration, — the — sign — language — of — the- 

deaf mute person is picked up and transmitted to the opponent 
party under certain conditions even when the deaf mute person 
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changes — his/her — position or — orientation, — thereby — enabling 
stable sign language conversation. — 

The — invention described — in claim 9 — ±-s — a sign language 

interpretation system which provides sign language 

interpretation in case the sign language video input/output 
device according to claim 7 or 8 is used by a deaf mute person 
cap able — &€ — using — sign — language , — audio — input/ output — means 
connected to the videophone terminal is used by a non deaf mute 
person incapable of using sign language, — and the videophone 
terminal — and another — videophone — terminal — used — by — a — sign 
language interpreter are interconnected to allow the deaf mute 

person t~e converse with fefee non deaf mute person, 

characterized in that the sign language interpretation system 
comprises — connection means — equipped — with — a — sign — language 
interpreter registration table where the terminal number of 
the videophone terminal used by a sign language interpreter 
is registered, — the connection means including a function to 
accept a call from the videophone terminal used by the deaf mute 
person and non deaf mute persons, — a function to extract the 
terminal number of a sign language interpreter from the sign 
language interpreter registration table, and a function to call 
the videophone terminal used by a sign language interpreter 
by using the extracted terminal number of the sign language 
interpreter . — 

With this configuration, — the deaf mute person obtains 
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a sign language interpretation service with a videophone — if* 
a — conversation — with — a — non deaf mute — person, — while — freely 
shifting his/her sight line, orientation or position by using 
the video input/output — device according to the invention, — 

As a function is provided to extract and call the terminal 

number of a sign — language — interpreter registered in a sign 
language — interpreter — registration — table, — a — sign — language 
interpreter — e-etfi — present — a — sign — language — interpretation 
anywhere he/she may be, as long as he/she can be reached, — This 
provides a flexible and efficient sign language interpretation 
system. — - 

The invention described in claim 10 is the sign language 

interpretation system according to claim 9, characterized in 
that — selection — information — &e^e — selecting — a — sign — language 
interpreter — 3rs — registered in the sign — language interpreter 
registration — table and that the connection means includes — a 
function — t-e — acquire — the conditions — §ea? — selecting — a — sign 
language interpreter from the calling videophone terminal and 
a function to extract the terminal number of a sign language 
interpreter who satisfies — the acquired selection conditions 
#e^r — fehre — sign — language — interpreter — from — fehe — sign — language 
interpreter registration table. — 

With this configuration, a sign language interpreter who 
satisfies — the object — of the conversation over — a videophone 
between a deaf mute person and a non deaf mute person from 
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among the sign language — interpreters — registered in the sign 
language interpreter registration table can be selected. — 

As — the — sign — language — interpreter — registration — table 

includes an availability flag to register whether a registered 
sign language — interpreter is — available , — and the connection 
means — references — an availability — flag in the sign language 
interpreter registration table to extract the terminal number 
of an available sign language interpreter, — it is possible to 
automatically select an available sign language interpreter, 
thereby — eliminating — useless — calling — a**d — providing — a — more 
flexible and efficient — sign language interpretation system. - 
The above object, — other objects, characteristics and 
advantages of the invention will be apparent from the following 
detailed description of the embodiments of the invention made 
referring to drawings, 

Brief Description of the Drawings 

At least one of the first communications means and the 

second communications means preferably includes radio 
communications means for performing radio communications with 
the videophone terminal, and a deaf-mute person and a 
non-deaf-mute person can obtain sign language interpretation 
by a sign language interpreter while traveling freely. 

According to another preferred embodiment of the present 

invention, a sign language interpretation system for providing 
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sign language interpretation in a conversation between a 
deaf-mute person and a non-deaf -mute person in which the 
videophone sign language interpretation assistance device 
according to the preferred embodiment described above is 
connected to the videophone terminal of the deaf-mute person 
and the videophone terminal of the deaf-mute person and the 
videophone terminal of a sign language interpreter are 
int erconnected, wherein the sign language interpretation 
system includes terminal connection means equipped with a sign 
language interpreter registration table in which the terminal 
number of the videophone terminal used by a sign language 
interpreter is registered, the terminal connection means 
including a function to accept a call from the videophone 
terminal of a deaf-mute person, a function to extract the 
terminal number of the videophone terminal of a sign language 
interpreter from the sign language interpreter registration 
table, and a function to call the videophone terminal of the 
sign language interpreter using the extracted terminal number 
of the sign language interpreter, and connection from the 
videophone terminal of the deaf-mute person to the terminal 
connection means automatically connects to the videophone 
terminal of the sign language interpreter. 

Selection information for selecting a sign language 

interpreter is preferably registered in the sign language 
interpreter registration table, the terminal connection means 
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preferably includes a function to acquire the conditions for 
selecting a sign language interpreter from the videophone 
terminal of a deaf-mute person and a function to extract the 
terminal number of a sign language interpreter who satisfies 
the acquired selection conditions for the sign language 
interpreter from the sign language interpreter registration 
table, and a desired sign language interpreter can be selected 
from the videophone terminal of the deaf-mute person. 

The terminal connection means preferably includes a 

function to register a term in the term registration table via 
an operation from a videophone terminal, a function to select 
a term to be used from the terms registered in the term 
registration table via an operation from a videophone terminal , 
a function to generate a telop of the selected term, and a 
function to synthesize the generated telop onto a video to be 
transmitted to the opponent terminal so as to display, in a 
telop, on the videophone terminal of the opponent terminal a 
term that is difficult to explain with sign language during 
sign language interpretation or a word that is difficult to 
pronounce . 

Since the sign language interpreter registration table 

includes an availability flag to register whether a registered 
sign language interpreter is available, and the connection 
means references an availability flag in the sign language 
interpreter registration table to extract the terminal number 
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of an available sign language interpreter, it is possible to 
automatically select an available sign language interpreter, 
thereby eliminating useless calling and providing a more 
flexible and efficient sign language interpretation system. 

Other features, elements, steps, characteristics and 

advantages of the present invention will become more apparent 
from the following detailed description of preferred 
embodiments with reference to the attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a sign language video 
input/output device according to a^a preferred embodiment of 
the present i nvention; 

Fig. 2 is a system block diagram of a sign language 
interpretation system according to a^ a preferred embodiment 
of the present i nvention; 

Fig. 3 is a processing flowchart of a controller in a 
sign language interpretation system according to eft a preferred 
embodiment of t-he- the present i nvention; 

Fig. 4 shows an example of a sign language interpreter 
registration table ; 

Fig. 5 shows an example of a screen for prompting input 
of sign language interpreter selection conditions ; 

Fig. 6 shown an example of a screen for displaying list 
of sign language interpreter candidates; 



17 



Fig. 7 is a system block diagram of a sign language 
interpretation system according to another preferred 
embodiment of the present i nve ntion; 

Fig. 8 shows an example of a connection table; 

Fig. 9 is a processing flowchart of a controller in a 
sign language interpretation system according to another 
preferred embodiment of the pr esent invention; and 

Fig. 1 0 is a conceptual diagram showing a case where 
situation in which a sign language interpretation service is 
obtained by using a prior art videophone terminal. 

Best Mode — for Carrying — Gut — t-he — Invention 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
Fig. 1 is a block diagram of a sign language video 
input/output device according to a** a preferred embodiment of 
the present invention. This preferred embodiment shows a case 
where situation in which a deaf-mute person A who is away from 
home uses a videophone to call a sign language interpreter C 
in order to have a conversation with a non-deaf -mute person 
B who is incapable of using sign language. 

In Fig. 1 , a-numeral 10 represents a videophone terminal 
for sign language interpretation recipients (hereinafter 
referred to as a sign language interpretation recipients 
terminal) used by a deaf-mute person A or a non-deaf -mute person 
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B in order to obtain a sign language interpretation service. 
A numcral Numeral 20 represents a videophone terminal for sign 
language interpreters (hereinafter referred to as a sign 
language interpreter terminal) used by a sign language 
interpreter . 

The sign language interpretation recipients terminal 10 
compriscG includes , as equipment for a deaf-mute person A, a 
display device 12 for displaying a sign language video, a 
fixture 1 3 for sctting locating the display device 1 2 in front 
of the eyes of the deaf-mute person, a sign language imaging 
camera 14 for picking — up — tfee — capturing images of the sign 
language of the deaf-mute person, a waist fixture 1 5 for fixing 
the sign language imaging camera 1 4 at the waist of the 
deaf-mute person, and a sign language video input/output device 
including the display device 12 and a videophone connection 
device 16 for connecting the sign language imaging camera 14 
to the videophone terminal 10. The sign language 
interpretation recipients terminal 10 also compriocG includes , 
as equipment for a non-deaf -mute person B, a headset for audio 
input/output 18. 

The sign language interpreter terminal 20 also 
comprise g includes a video display section 20a for displaying 
a video, an imaging section 20b for picking up capturing images 
of the sign language of a sign language interpreter, and a 
headset for audio input/output 20c. 



19 



The display device 1 2 uscs is defined, for example , by 
a small-sized liquid crystal display having a sufficient 
resolution to display a sign language video. The display 
device 1 2 cnlargcs magnif ies a video ee- such that a deaf-mute 
person can recognize the sign language displayed with the 
fixture 13 attached. On the surface of the display device 12 
i-s — attached — j_a convex lens s^ is attached such that sign 
language displayed on the display device 1 2 is substantially 
brought into focus while the deaf-mute person is viewing the 
outer worlds such as the conversation partner and the scenery. 
This allows e nables the deaf-mute person to normally easily 
recognize the sign language displayed on the display device 
12 while viewing the outer world. 

The fixture 13 h^rs includes a spectacle frame structure 
which can be fixed to the ears and nose of a deaf-mute person. 
Near the frame in front of the eyes of the deaf-mute person 
is attached , the display device 1 2 is attached for viewing 
ef-sign language without impairing the sight of the outer world . 

While the display device 12 is provided in a lower left 

position location in front of the eyes of the deaf-mute person 
in this example/ irt — the display device 1 2 may be provided 
anywhere as long as it does not impair the sight of the outer 
world. 

While the display devices 1 2 are provided on the same 
right and left pooitionG locatio ns of the fixture 1 3 so as to 
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provide more clearly recognize the clear recognition of the 
displayed sign language in this example, the display unit 12 
may be provided on either side of the fixture 1 3 as long as 
the deaf-mute person can easily recognize the displayed sign 
language . 

The fixture 1 3 is used to ee-^ locate the display device 
12 in front of the eyes of the deaf-mute person, ^o such that 
the display device 12 may be fixed to a hollow frame. Or, a 
transparent plate may be provided in a frame and the display 
unit 12 may be stuck adhered to the transparent plate. In case 
the deaf-mute person has myopia, hyperopia, astigmatism, or 
presbyopia^ and thus^_ needs a corrective lens, a corrective 
lens may be provided in a frame and the display device 12 may 
be stuck adhered to the correct ive lens . 

The sign language imaging camera^ 14 which may be such 
as a small-sized CCD camera^ is fixed to the waist fixture 15. 
In this practice, — the The sign language imaging camera 14 is 
set to an angle of view that is wide enough to pick up capture 
images of the sign language of the deaf-mute person while it 
is fixed to the waist fixture 15. 

The waist fixture 15 is^ for example^ a belt to £^be 
fixed at the waist of a deaf-mute person. Any waist fixture 
may be used whoop w hich includes a buckle ka- &having an arm for 
fixing the sign language imaging camera 14 to allow e nable the 
sign language imaging camera 14 to be set in an orientation 
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where in which the sign language of the deaf-mute person can 
be picked up. captured. This makes it possible to stably pick 
tap e apture the sign language of the deaf-mute person by using 
the sign language imaging camera 1 4_^_ even when the deaf-mute 
person changes his/her position or orientation. 

The videophone connection device 16 is a device which 
connects the display device 1 2 and the sign language imaging 
camera 14 with the external device connecting terminal of the 
videophone terminal 10. The videophone connection device 16 
supplies a video signal bcing that is received by the videophone 
terminal 10 to the display device 12 as well as , and supplies 
a video signal from the sign language imaging camera 14 to the 
videophone terminal 10. Thus^_ the display device 12 
serves functions as an external video display device of the 
videophone terminal 1 0 and the sign language imaging camera 
14 serves functions as an external video input device of the 
videophone terminal 1 0 . 

Next, the operation for a conversation between the 
deaf-mute person A and the non-deaf -mute person B via the sign 
language interpreter C by using such a sign language video 
input/output device will be described. 

The deaf-mute person A wears the fixture 1 3 and the waist 
fixture 1 5_^_ and connects the videophone connection device 1 6 
to the external device connection terminal of the sign language 
interpretation recipient terminal 10. 
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The non-deaf -mute person B wears the headset 18 and 
connects the headset 18 to the audio input/output terminal of 
the sign language interpretation recipient terminal 10. 

£ft — this — at atc Next , the deaf-mute person A or the 
non-deaf -mute person B calls the sign language interpreter 
terminal 20 used by a sign language interpreter from the sign 
language interpretation recipient terminal 10. 

The sign language interpreter C accepts the request for 
sign language interpretation, sets the sign language 
interpreter videophone terminal 20 while watching the video 
display section 20a ^e— such that his/her sign language will 
appear in the imaging section 20b, and wears the headset 20a_j_ 
and connects it to the audio input /output terminal of the sign 
language interpreter videophone terminal 20. 

When the deaf-mute person A performs sign language, ■arts- 
video of the sign language is piclccd up captured by the sign 
language imaging camera 14, transmitted from the sign language 
interpretation recipient terminal 10 to the sign language 
interpreter terminal 20, and displayed in the video display 
section 20a. The sign language interpreter C can watch watches 
the sign language of the deaf-mute person A displayed in the 
video display section 20a and translate translates the sign 
language into a voice. The voice translated into voice by the 
sign language interpreter C is collected by the microphone of 
the headset 20c, transmitted from the sign language interpreter 
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terminal 20 to the sign language interpretation recipient 
terminal 10, and output to the earphone of the headset 18. The 
non-deaf -mute person B listens to the voice translated into 
by the sign language interpreter C to understand the sign 
language of the deaf-mute person A. 

On the other hand, the voice of the non-deaf -mute person 
B is collcctcd captured by the microphone of the headset 18, 
transmitted from the sign language interpretation recipient 
terminal 10 to the sign language interpreter terminal 20, and 
output to the earphone of the headset 20c. The sign language 
interpreter C listens to the voice of the non-deaf -mute person 
B and translates it into sign language. The sign language 
translated into by the sign language interpreter C is picked 
upc aptured by the imaging section 20b, transmitted from the 
sign language interpreter terminal 20 to the sign language 
interpretation recipient terminal 10, and displayed on the 
display device 12. The deaf-mute person A watches the sign 
language translated into by the sign language interpreter C 
to understand the voice of the non-deaf -mute person B. 

The sign language translated into by the sign language 
interpreter C is displayed on the display device 12 fixed by 
the fixture 13 in front of the eyes of the deaf-mute person 
A. Thus_j_ the deaf-mute person A can converse with the 
non-deaf-mute person B while freely shifting his/her sight line 
The deaf-mute person A can watch the sign language translated 
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into by the sign language interpreter C while checking the 
cxprcGGion observing the expressions of the non-deaf -mute 
person B or watch the sign language translated into by the sign 
language interpreter C while checking observing an object 
that is a target of conversation with the non-deaf -mute person 
B. This provides a quick conversation and deeper 
understanding of the o pponcnt ' s partner / s intention. 

The sign language of the deaf-mute person A is picked 
up captured by the sign language imaging camera 14 fixed with 
the waist fixture 1 5_^_ and is thus_^_ captured stably even when 
the deaf-mute person A changes his/her position or orientation . 
This assumes the cxtrcmc provides the ultimate freedom of the 
movement and b ehavior of the deaf-mute person A. 

While the fixture 1 3 for fixing the display device 1 2 
in front of the eyes of a deaf-mute person uses a spectacle 
frame structure in the above -described preferred embodiment , 
the fixture 13 may comprisc include a hair band fixed on the 
head equipped with an arm for supporting the display device 
12, or may have any structure as long as it can fix the display 
device 12 in front of the eyes of the deaf-mute person. 

While the sign language imaging camera 14 comprises 
includes the waist fixture 1 5 fixed at the waist of the 
deaf-mute person in the above -described preferred embodiment, 
the sign language imaging camera 1 4 may use any type of fixing 
means as long as it can pick up capture the sign language of 
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the deaf-mute person and provides the same effect and 
advantages of trhe- the present invention. 

While the videophone connection device 16 connects the 
display device 12 and the sign language imaging device 14 with 
the external device connecting terminal of the videophone 
terminal 1 0 via wires in the above - described preferred 
embodiment, a radio communications device for wirelessly 
transmitting/receiving a video signal may be provided on each 
of the external device connecting terminal of the videophone 
terminal 10, the fixture 13 and the waist fixture 15. This 
eliminates the need for cabling the videophone terminal 10, 
the fixture 1 3 , and the waist fixture 1 5 , which provides extreme 
ease of greatly facilit ates handling. 

In casc lf the videophone terminal 1 0 compr i go g includes 
a wireless interface conforming to a Standard such as 
Bluetooth® for communicating with an external device, a 
communications device conforming to the same Standard should 
be provided on each of the fixture 13 and the waist fixture 
15. By doing so, it is possible to communicate a video signal 
without physically connecting anything to the videophone 
terminal 10 as long as the communications devices provided on 
the fixture 13 and the waist fixture 15 are within the service 
area of the wireless interface of the videophone terminal 10, 
which adds to the ease of handling. 

A radio communications device for communicating an audio 
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signal by radio may also be provided on the headset 18 for 
non-deaf -mute persons also — to communicate with the sign 
language interpretation recipient terminal 1 0 in a cableless 
fashion. In this caoc si tuation , an audio input/output channel 
may be provided on the videophone connection device 16 to 
perform audio communications as well as video signal 
communications. This allows e nables the non-deaf -mute person 
B to move freely as long as he/she is within the service area 
of the radio communications device. 

As mentioned earlier, — in caac above, if the videophone 
terminal 1 0 compriGcs includes a wireless interface conforming 
to a Standard to communicate with an external device such as 
Bluetooth® , a communications device of the same Standard should 
be used on the headset 18. While audio input/output uses a 
headset for the non-deaf -mute person B also in the 
above -de scribed preferred embodiment, the non-deaf -mute 
person B does not use sign language so such that he/she may use 
a hand microphone and an external loudspeaker. For a 
videophone terminal of the cellular phone type, he/she may 
directly hold the main unit with his/her hands to perform audio 
communications with the sign language interpreter C. 

While the abovo above preferred embodiment describes a 
videophone terminal of the telephone type, especially a 
videophone terminal of a cellular phone type, the present 
invention is not limited thereto but , and a videophone terminal 
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of the IP type to connect to the I ntornot internet may be equally 
used. 

While the above preferred embodiment describes a sign 
language video input /output device compriGing including both 
a display device 12 for displaying a sign language video and 
a sign language imaging camera 14 for picking up capturing sign 
language, a sign language video presentation device 
comprising including a display device 12 for displaying sign 
language video, a fixture 13 for fixing the display device 12 
in front of the eyes of a deaf-mute person, and a videophone 
connection device 16 for supplying a sign language video being 
received by a videophone terminal 1 0 to the display device 1 2 
may allow e nable a deaf-mute person to — receive an 

explanation by sign language via a videophone while viewing 
the outer world by freely shifting his/her sight line , which 
provides the effect of — the invention . 

Alt is not necessary for a sign language video need not 
necessarily to be received by a videophone but , and a dedicated 
video signal receiver may be used instead . For example, a 
transmitter for transmitting ars — a sign language video £-he 
explanation in the sightseeing guidance or exhibition on a 
sightseeing spot may be provided and the sign language video 
may be received by a sign language video presentation device. 
By doing so, same — as — tfee — similar to audio guidance or 
explanation for a non-deaf -mute person, a deaf-mute person 
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get o receives guidance or explanation by sign language while 
freely shifting his/her sight line-? — and. Thus, a deaf-mute 
person can enjoy sightseeing or a study tour, samo in a similar 
manner as a non- deaf -mute person. 

Next, a sign language interpretation system will be 
described which allows enables selection of a sign language 
interpreter satisfying the object of a conversation in case 
where a deaf-mute person converses with a non-deaf -mute person 
by using a sign language video input/output device according 
to a preferred embodiment of the present invention . 

Fig. 2 is a system block diagram of a sign language 
interpretation system according to an— a preferred embodiment 
of the present invention . In this preferred embodiment , a 
deaf-mute person and a non-deaf -mute person ugqg use the sign 
language video input/output device to propose a sign language 
interpretation service from a single videophone terminal. 

In Fig. 2, a— numeral 100 represents a sign language 
interpretation system installed in a sign language 
interpretation center which provides a sign language 
interpretation service. The sign language interpretation 
system 100 interconnects, via a public telephone line 30, a 
sign language interpretation recipient terminal 1 0 used by a 
deaf-mute person A and a non-deaf -mute person B and a sign 
language interpreter terminal 20 used by a sign language 
interpreter C to provide a sign language interpretation service 
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in a conversation between the deaf-mute person and the 
non-deaf-mute person. In this this preferred embodiment, both 
the sign language interpretation recipient terminal 10 and the 
sign language interpreter terminal 20 are videophone terminals 
of the telephone type connected to a public telephone line, 
and in particular^ wireless videophone terminals of the 
cellular phone type which can be carried e« — the road. when 
traveling. 

Such a videophone terminal connected to a public line 
may be an ISDN videophone terminal based on ITU-T 
recommendation H.320, the present invention is not limited 
thereto and may use a videophone terminal which employs 
operates according to a unique protocol. 

The sign language interpretation system 100 
compri so s includes a line interface for the —sign language 
interpretation recipient terminal to connect to a sign 
language interpretation recipient terminal (hereinafter 
referred to as an I/F) 120 and a line I/F for the sign language 
interpreter terminal 140 to connect to a sign language 
interpreter terminal. To each I/F are connected a 
multiplexer/demultiplexer 122, 142 for 

multiplexing/demultiplexing a video signal, an audio signal 
or a data signal, a video CODEC (coder /decoder ) 1 24, 1 44 for 
compressing/expanding a video signal, and an audio CODEC 126, 
146 for compressing/expanding an audio signal. Each line I/F, 
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each multiplexer/demultiplexer, and each video CODEC or each 
audio CODEC perform call control, streaming control 
compression/expansion of a video/audio signal in accordance 
with a protocol used by each terminal. 

To the video input of the video CODEC for the —sign 
language interpretation recipient terminal 1 24 is connected ^ 
a video synthesizer 1 28 is connected for synthesizing the video 
output of the video CODEC for the sign language interpreter 
terminal 144 and the output of the telop memory for the sign 
language interpretation recipient terminal 130. 

To the audio input of the audio CODEC for the sign language 
interpretation recipient 126 is connected , the audio output 
is connected of the audio CODEC for the sign language 
interpreter terminal 146. 

To the video input of the video CODEC for the sign language 
interpreter terminal 144 is connected , a video synthesizer 
148 is connected for synthesizing the video output of the video 
CODEC for the sign language interpretation recipient terminal 
124 and the output of the telop memory for the n sign language 
interpreter terminal 1 50. 

To the audio input of the audio CODEC for the sign language 
interpreter person terminal 146 is connected _^_the audio output 
is connected of the audio CODEC for the sign language 
interpretation recipient terminal 126. 

The sign language interpretation system 100 is 
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equippcd p rovided with a sign language interpreter 
registration table 182 where in which the terminal number of 
a terminal for sign language interpreters used by a sign 
language interpreter is registered^ and includes a controller 
180 connected to each of the line I/Fs 120, 140, 
mul.tipl.exers/demultiplexers 1 22, 1 42, video synthesizers 128, 
148, and telop memories 1 32, 1 52. The sign language 
interpretation system 1 00 provides a function to connect a sign 
language interpretation recipient terminal and a sign language 
interpreter terminal by way of a function to accept a call from 
a sign language interpretation recipient terminal, a function 
to extract the terminal number of a sign language interpreter 
from the sign language interpreter registration table 182, a 
function to call the extracted terminal number, and also 
provides a function to switch a video/audio synthesis method 
used by video/audio synthesizers and a function to generate 
a telop and transmit the telop to a telop memory. 

The contents of each telop memory 132, 152 can be are 
set from the controller 180. When a sign language 
interpretation service with a videophone is established, a 
message for each terminal is set to each telop memory 1 32, 1 52, 
and a command is issued to each video synthesizer 1 28, 1 48 to 
select a signal of each telop memory 1 32, 1 52. Thus^_ a 
necessary message is transmitted to each terminal and a sign 
language interpretation connection is established. 
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■ifi — ease l f there is a term which is hard dif f icult to 
explain using sign language or a word — term which is 
hard dif f icult to pronounce in a sign language interpretation 
service with a videophone, art — is possible — to rcgistcr t hese 
terms may be registered in advance the — term — in the term 
registration table 184 of the controller 180 in association 
with the number of the dial pad on each terminal. By doing 
so, it is possible to detect a push press of a key on the dial 
pad on each terminal during a sign language interpretation 
service, extract the term corresponding to the number of the 
dial pad pressed from the term registration table, generate 
a text telop, and set the text telop to each telop memory, 
thereby displaying the term on each terminal. 

With this configuration, a term which is hard dif f icult 
to explain using sign language or a word term which is 
hard dif f icult to pronounce is transmitted to the opponent other 
party by way of via a text telop, thus_^ providing a quicker and 
more to-the-point sign language interpretation service. 

Next, a processing flow of the controller 180 for 
providing a sign language interpretation service is shown. 

Prior to processing, information to select a sign 
language interpreter and the terminal number of a terminal used 
by each sign language interpreter are registered in the sign 
language interpreter registration table 182 of the controller 
180 from an appropriate terminal (not shown). Fig. 4 shows 
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an example of registration item to be registered in the sign 
language interpreter registration table 182. The information 
to select a sign language interpreter refers to information 
used by the user to select a desired sign language interpreter, 
which includes a sex, an age, a habitation, a specialty, and 
the level of sign language interpretation. The habitation 
assumes a case whcrc si tuation in which the user dosircs want s 
a person who has geographic knowledge on a specific area and, 
in this example,- a ZIP code is used to specify an area. The 
specialty assumes a case where, — in case situation in which, 
when the conversation pertains to a specific field, the user 
desircs w ants a person who has expert knowledge oftof the field 
or is familiar with the topics in the field. In this example, 
the fields a sign language interpreter is familiar with are 
classified into several categories to be registered, such as 
politics, law, business, education, science and technology, 
medical care, language, sports, and hobby. The specialties 
are diverse, -se such that they may be registered hierarchically 
and searched through at a level desired by the user when 
selected. 

In addition, qualifications of each sign language 
interpreter may be registered in advance for the user to select 
a qualified person as a sign language interpreter. 

The terminal number to be registered is the telephone 
number of the terminal, because in this example a videophone 
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terminal to conncct is connected to a public telephone linens- 
assumed . 

In the sign language interpreter registration table 182 
is provided , an availability flag is provided to indicate 
whether sign language interpretation can be accepted. A 
registered sign language interpreter can call the sign language 
interpretation center from his/her terminal and enter a command 
by using a dial pad to set/reset the availability flag. Thus, 
a sign language interpreter registered in the sign language 
interpreter registration table can set the availability flag 
only when he/she is available for sign language interpretation, 
thereby eliminating useless calling and allowing enabling the 
user to select an available sign language interpreter without 
delay. 

Fig. 3 shows a processing flowchart of the controller 
180. In the sign language interpretation system 100, a sign 
language interpretation recipient terminal makes a call to a 
telephone number on the line I/F of the sign language 
interpretation recipient terminal to call a sign language 
interpreter terminal, thereby establishing a videophone 
connection via sign language interpretation. 

As shown in Fig. 3, it is first detected that the line 
I/F for the sign language interpretation recipient terminal 
120 is called (S100). Next, the calling terminal displays a 
screen to prompt input of the selection conditions for a sign 
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language interpreter shown in Fig. 5 (S1 02) . The sign language 
interpreter selection conditions input by the caller are 
acquired (S104). The sign language interpreter selection 
conditions input by the caller are sex, age bracket, area, 
specialty and sign language level. A corresponding sign 
language interpreter is selected based on the sex, age, 
habitation, specialty, and sign language level registered in 
the sign language interpreter registration table. The area 
is specified by using a ZIP code and a sign language interpreter 
is selected starting with the habitation closest to the 
specified area. For any selections, if* — casc if it is not 
necessary to specify a condition, N/A may be selected. 

Next, a sign language interpreter with availability flag 
set is selected from among the sign language interpreters 
satisfying the selection conditions acquired referring to the 
sign language interpreter registration table 1 82 . The calling 
terminal displays a list of sign language interpreter 
candidates shown in Fig. 6 to prompt input of the selection 
number of a desired sign language interpreter (S106). The 
selection number of the sign language interpreter input by the 
caller is acquired (S108) and the terminal number of the 
selected sign language interpreter is extracted from the sign 
language interpreter registration table and the terminal is 
called (S110). When the sign language interpreter terminal 
has accepted the call (S112), a sign language interpretation 
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service starts ( S 1 1 4 ) . 

■3Ha — CQGc If the sign language interpreter terminal 
selected in SI 1 2 does not accept the call, whether a next 
candidate is available is determined (S1 1 6) . In casc lf a next 
candidate is available, execution returns to S1 1 0 and the 
procedure is repeated. Otherwise the calling terminal is 
notified as such and the call is released (S118). 

While in casc if the selected sign language interpreter 
terminal does not accept the call, the caller is notified as 
such and the call is released in the above -described preferred 
embodiment, a sign language interpretation reservation table 
to register a calling terminal number may be provided and the 
caller may be notified on a later response from the selected 
sign language interpreter to set a sign language interpretation 
service . 

While the sign language interpretation system 100 
comprises includes a line I/F, a mult iplexer /demultiplexer , a 
video CODEC, an audio CODEC, a video synthesizer, an audio 
synthesizer and a controller in the above -described preferred 
embodiment, these components need not be implemented by 
individual hardware (H/W-) — but ) , and the function of each 
component may be implemented based on by software running on 
a computer. 

While the sign language interpreter terminal 20, same 
ao the sign language interpretation recipient t e rminal 10, is 
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located outside the sign language interpretation center and 
called from the sign language interpretation center over a 
public telephone line to provide a sign language interpretation 
service in the above -described preferred embodiment, the 
present invention is not limited thereto but part , a portion 
or all of the sign language interpreters may be provided in 
the sign language interpretation center to provide a sign 
language interpretation service from the sign language 
interpretation center . 

In the above -described preferred embodiment, a sign 
language interpreter can present — a provide sign language 
interpretation ocrvi cc services anywhere he/she may be, as long 
as he/she has a terminal which can be connected to a public 
telephone line. Thus^ the sign language interpreter can 
provide a sign language interpretation service by using the 
availability flag to make efficient use of free time. By doing 
so, it is possible to stably operate a sign language 
interpretation service accompanied by a problem of difficult 
reservation of a sign language interpreter . In particular, 
the number of volunteer sign language interpreters is 
increasing nowadays. A volunteer who is available only 
irregularly can provide a sign language interpretation service 
by taking advantage of a— limited free time. 

Fig. 7 is a system block diagram of a sign language 
interpretation system according to another preferred 
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embodiment of the present invention . This preferred 
embodiment shows a system configuration example assuming that 
each terminal used by sign language interpretation recipient 
and a sign language interpreter is an IP (Internet Protocol) 
type videophone terminal to connect to the Internet internet 
equipped with a web browser. 

In Fig. 7 , e-numeral 200 represents a sign language 
interpretation system installed in a sign language 
interpretation center to provide a sign language 
interpretation service. The sign language interpretation 
system 200 connects a sign language interpretation recipient 
terminal 40 used by a deaf-mute person and a non-deaf -mute 
person and any of the sign language interpreter terminals used 
by a sign language interpreter 231, 232, ... via the 
Internet internet 50 in order to provide a sign language 
interpretation service for the conversation between the 
deaf-mute person and the non-deaf -mute person. 

While each of the sign language interpretation recipient 
terminal 40 and the sign language interpreter terminals 231 , 
232 ,... each — comprises in eludes a general-purpose processing 
device (a) such as a personal computer having a video input 
I/F function, an audio input/output I/F function and a network 
connection function, the processing device equipped with a 
keyboard (b) and a mouse (c) for input of information as well 
as a display (d) for displaying a web page screen presented 
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by a web server 210 and a videophone screen supplied by a 
communications server 220, a television camera (e) for imaging 
the sign language of a sign language interpreter, and a headset 
(f) for performing audio input/output for the sign language 
interpreter, the processing device has IP videophone software 
and a web browser installed in this example, a dedicated 
videophone terminal may be used instead. 

The videophone terminal connected to the 
Int erne t int erne t may be an IP videophone terminal based on 

ITU-T recommendation H.323^ However , trh ethe present 

invention is not limited thereto but , and may use a videophone 
terminal which employs operates according to a unique protocol . 

The Internet may be ef — a wireless LAN type . The 
videophone terminal may be a cellular phone or a portable 
terminal equipped with a videophone function and also including 
a web access function. 

The sign language interpretation system 200 
compriscG : includes a communications server 220 including a 
connection table 222 for setting the terminal addresses of a 
sign language interpretation recipient terminal , a sign 
language interpreter terminal and a sign language interpreter 
terminal as well as a function to interconnect the terminals 
registered in the connection table 222 and synthesize a video 
and an audio received from each terminal and transmit the 
synthesized video and audio to each terminalf^ a web server 
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210 including a sign language interpreter registration table 
212 for registering the selection information, a terminal 
address — and — , an availability flag of a sign language 
interpreter as mentioned earlier, as well as and a function 
to select a desired sign language interpreter based on an access 
from a calling terminal by using a web browser and set the 
calling terminal and sign language interpreter terminal in the 
connection table 222 of the communication server 220-r^ a router 
250 for connecting the web server 210 and the communications 
server 220 to the Internet ; internet , and a plurality of sign 
language interpreter terminals 231, 232,..., 23N connected to 
the communications server 220 via a network. 

Fig. 8 shows an example of a connection table 222. As 
shown in Fig. 8, the terminal address of a calling terminal 
and the terminal address of a sign language interpreter 
terminal are registered as a set in the connection table 222 . 
This provides a single sign language interpretation service. 
The connection table 222 is designed to register a plurality 
of such terminal address se bsets depending on the throughput 
of the communications server 220, thereby simultaneously 
providing a plurality of sign language interpretation 
services . 

While the terminal address registered in the connection 
table 222 is preferably an address on the Internet internet and 
is generally an IP address, the present invention is not limited 
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thereto but — For example^ a name given by a directory 
server may be used. 

The communications server 220 performs packet 
communications using a predetermined protocol with the sign 
language interpretation recipient terminal and sign language 
interpreter terminal set to the connection table 222 and 
provides, by way of software processing, the functions similar 
to those provided by a multiplexer/demultiplexer 122, 142, a 
video CODEC 1 24, 144, an audio CODEC 1 26, 1 46, a video 
synthesizer 128, 148, in the above -described sign language 
interpretation system 100. 

With this configuration, same — as — feke — sign — language 
interpretation system 100, prescribed videos and audios are 
communicated between a sign language interpretation recipient 
terminal and a sign language interpreter terminal, and a sign 
language interpretation service is established for the 
conversation between the deaf-mute person and the 
non-deaf -mute person . 

While the sign language interpretation system 1 00 uses 
the controller 180 and the telop memories 1 32, 1 52 to extract 
a term registered in the term registration table 184 during 
a sign language interpretation service based on an instruction 
from a terminal and displays the term as a telop on the terminal, 
the same function may be provided by way of software processing 
by the communications server 220 in this preferred embodiment 
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also. A term specified by each terminal may be displayed as 
a popup message on the other terminal by way of the web server 
210. Or, a telop memory may be provided in the communications 
server 220 so that a term specified by each terminal via web 
browser will be written into the telop memory via the web server 
210 and displayed as a text telop on each terminal. 

While the sign language interpretation system 100 uses 
the controller 180 to interconnect a sign language 
interpretation recipient terminal and a sign language 
interpreter terminal, the connection procedure is made by the 
web server 210 in this preferred embodiment because each 
terminal has a web access function. 

Fig. 9 is a processing flowchart of a connection 
procedure by the web server 210. A sign language 
interpretation recipient wishing to receive a sign language 
interpretation service accesses the web server 210 in the sign 
language interpretation center by using a web browser to log 
in from a sign language interpretation recipient terminal, 
which starts begins the acceptance of the sign language 
interpretation service . 

As shown in Fig. 9, the web server 210 first acquires 
the terminal address of a caller (S200) and sets the terminal 
address to the connection table 222 (S202). Next, the web 
server delivers a screen to prompt input of the selection 
conditions for a sign language interpreter similar to that 
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shown in Fig. 5 to the calling terminal (S204) . The sign 
language interpreter selection conditions input by the caller 
are acquired (S206) . 

Next, a sign language interpreter with the availability 
flag set is selected from among the sign language interpreters 
satisfying the selection conditions acquired from the sign 
language interpreter registration table 212. The web server 
210 delivers a list of sign language interpreter candidates 
similar to that shown in Fig. 6 to the calling terminal to prompt 
input of the selection number of a desired sign language 
interpreter (S208) . The selection number of the sign language 
interpreter input by the caller is acquired and the terminal 
address of the selected sign language interpreter is acquired 
from the sign language interpreter registration table 212 
(S210). Based on the acquired terminal address of the sign 
language interpreter, the web server 210 delivers a calling 
screen to the sign language interpreter terminal (S212). if* 
CQoe lf the call is accepted by the sign language interpreter 
(S214) , the terminal address of the sign language interpreter 
is set to the connection table 222 (S216) and the sign language 
interpretation service starts ( S218) . 

In casc lf the sign language interpreter terminal does 
not accept the call in S214, whether a next candidate is 
available is determined (S220) . In caoc lf a next candidate 
is available, the web server delivers a message to prompt the 
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caller to select another candidate (S222) to the calling 
terminal, then execution returns to S210. In casc lf another 
candidate is not found, the web server notifies the calling 
terminal as such (S224 ) and the call is released. 

While in casc if the selected sign language interpreter 
terminal does not accept the call, the caller is notified a-s- 
such and the call is released in the above -described preferred 
embodiment, a sign language interpretation reservation table 
to register a calling terminal address may be provided and the 
caller may be notified on a later response from the selected 
sign language interpreter to set a videophone conversation. 

While the sign language interpreter terminal is 

preferably located in the sign language interpretation system 

200 of the sign language interpretation center in the 

above -described preferred embodiment, the present invention 

is not limited thereto but , and some or all of the sign language 

interpreter terminals may be provided outside the sign language 

interpretation center and connected via the Internet. 

In the above cmbodimcnt -descr ibed preferred embodiments , 

the configuration of the sign language interpretation system 

has been described for a case — where — situation in which a 

videophone terminal used by a sign language interpretation 

recipient or a sign language interpreter is a telephone- type 

videophone terminal connected to a public telephone line^ and 

a case wherc situation in which the videophone terminal is an 
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IP- type videophone terminal connected to the I ntcrnct interne t , 
the telephone-type videophone terminal and the IP-type 
videophone terminal can communicate with each other by 
arranging a gateway to perform protocol conversion 
therebetween. A sign language interpretation system 
conforming to one protocol may be provided via the gateway to 
support a videophone terminal which oonf orming conf o rms to the 
other protocol. 

In this way manner , the sign language interpretation 
system allowo enables the user to enjoy or provide a — sign 
language interpretation ocrvicc services anywhere he/she may 
be, as long as he/she has a terminal which can be connected 
to a public telephone line or the Internet. A sign language 
interpreter does not always have to visit a sign language 
interpretation center^ but but rather, can present a sign 
language interpretation from his/her home or a facility or site 
where a videophone terminal is located, or provide a sign 
language interpretation service by using a cellular phone or 
a portable terminal equipped with a videophone function. 

A person with the ability of sign language interpretation 
may wish to register in the sign language interpreter 
registration table in the sign language interpretation center 
in order to provide a sign language interpretation service 
anytime when that it is convenient to for him/her. From the 
viewpoint of the operation of the sign language interpretation 
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center, it is not necessary to oummon have sign language 
interpreters t-oat the center. This allows enables efficient 
operation of the sign language interpretation center both in 
terms of time and costs . In particular, the number of volunteer 
sign language interpreters is increasing nowadays. The sign 
language interpretation service can be provided from a sign 
language interpreter's home, which facilitates reservation of 
a sign language interpreter. 

Industrial Applicabili ty 

As mentioned above, according to thc pref erred 
embodiments of the present invention, a deaf-mute person 4rB 
ablc to gct can receive an explanation by sign language while 
viewing the outer world by freely shifting his/her sight line. 
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